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ABSTRACT 

The current progress of the National Assessment of 
Educational progress (NAEP) is examined, and its tackground is 
summarized. Federally financed since the late 1960»s, the NAEP is a 
survey of U.S. students' achievment in various subject areas. As an 
indicator of change in elementary and secondary educational 
achievement, it has received attention with regard to measuring 
progress toward the National Education Goals, Until recently, 
assessments have ijeen conducted for the nation as a whole and tyy 
region, but net on a state or local basis. However, a voluntary state 
demonstration project was authorized for 1990 and 1992 assessments to 
determine whether valid and reliable data could be obtained at the 
state leval? preliminary information should be avai'd^le by the 
summer of 1993, The NAEP was given its statutory basis in 1978, was 
last amended in 1988, and is presently authorized through 1993. It is 
currently conducted by the Educational Testing Service under contract 
with the National Center for Mucitici statistics, (SLD) 
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Background and Status 



Paul M. Irwin and James B. Stedman 
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SUMMARY 



This report examine the current status of ihe National Assessment of 
Educational Progress (NAEP), and summarizes its background. Federally 
financed since the late l%Os, the NAEP is a survey of U.S. students' 
achievement in various subject areas. It serves as an indicator of change in 
elementaxy and secondary educational achievement over the past two decades. 
As such, it has received additional attention with regard to measuring progress 
toward the National Education Goals. The NAEP is authorized through FY 
1993; the FY 1991 appropriation is $19.2 million. Until recently, ass^ments 
have been conducted for the Nation as a whole and by region, but not on a State 
basis or by school district, school, or pupil. However, a voluntary State 
demonstration project wbb authoriz^ for the 1990 and 1^2 asrossments (grade 
8 mathematics in 1990, grades 4 and 8 mathematii^ and grade 4 reading in 
1992) to determine whether valid and reliable data could be obtained at the 
State level; preliminaiy information from this trial should be available by the 
summer of 1991. First supported under Federal discrationary authority, the 
NAEP was given a specific statutoiy basis in 1978, and was last amended in 
1988. The NAEP is eurrer tly conducted by the Educational Testing Service, 
under contract with the National Center for Ekiucation Statistios (NCE^) within 
the U.S. Department of Education (ED). 



SELECTED CURKENT ISSUES 



Interest in NAEP has recently increased for several reasons. First, the 
initial 1990 State demonstration project will begin to yield results in the 
summer of 1991, and the preparation for the 1992 State demonstration is now 
well underway.' More accurate indicators of State education sj'Stems have been 



'In part because a lead time of several years is required, the Congress 
\^ authorized two trial State assessments. Evaluations are to be completed within 

^ 18 months of each assessment, but the praparation for the 1992 demonstration 

^ will be nearly complete before the results of the 1990 assessment are known. 
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necided to measure their performance. Valid State data from NAEP might 
provide this information, similar to what the NAEP currently provide at the 
national level. Some have recommended Uiat the authority to conduct such 
comparisons he made jKrmanent, and even be expanded to the local educational 
agency level, while others want to evaluate the current demonstration before 
authorizing additional State assMsments. NAEP officials have sought the 
extension of NAEP authority for fUture State asBemments; they claim that 
substantial planning must begi;i now in order to ronduct ai^ State assessment 
in 1994. 

Second, NAEP is the only existing national achievement teat and has thus 
seemed an attractive potential mechanism for measuring progress toward ^rtain 
of the national education goals.^ More specifically, the reference in the third 
goal --of demonstrated competency over challenging subject matter in grades 4, 
8, and 12-seems clearly related to the NAEP testing structure (describeJ below 
in Content and Design section). Further, under a 1988 provision, the National 
Assessment Governing Board (NAGB) must identify "appropriate achievement 
goals" for each age and grade in each subject area to be tested; this r^H^uirement 
has r^eived attrntion due to its potential relationship to the goals asi^ssment 
process. Through this 'pTcxz:^ of identifyin,^ achievement levels, NAEP reports 
would assess the adequate of student performance. 

An underlying theme in these ianies is that increasing the stakes of the 
NAEP process-using NAEP scores as a basis for State achievement comjMsirisons, 
and for measuring progress toward meeting the national education goals— raises 
concerns about the nature and development of this national test, and the role 
of the Federal Government in supporting it. 

EARLY HISTORY 

In 1963, U.S. Commissioner of Educati^tii Francis Keppe! asked the 
Carnegie Corporation of New York to initiate ii. project to provide data on the 
outputs of U.S. elementary and se^ndary education. The Exploratory 
Committee on Assessing the Progre^ of Education (ECAPE), appointed by 
Carnegie, laid the groundwork for the first NAEP effort. The committee was 
funded by Carnegie and tiie Ford Foundation's Fund for the Advancement of 
Eklucation. In July 19G8, ECAPE turned tiie project over to ^he Committee on 
Assessing the Progrera of Education (CAPE) for implementation. CAPE was 
funded by the U.S. Office of Education, Carnegie, and Ford. In Jul/ 1^9, the 
functions of CAPE were assumed the recently established Edu(»tion 
Commission of the States. The first round of the assessment was conducted in 
calendar year 1969 and covered writing, science, and citizenship. 



^or a discussion of these goals and related issues, see U.S. Labraiy of 
Congress. Congressional Research Service. National Education Goals: Where 
Are We Now? CRS Report for Congress No. 90-169 EPW, by Jamee B. Stedman, 
et al. Washington, 1990. 
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As originally de^i^et', NAEP focu^ on the performance of students at 
ager 9, 13, and li, and adults. It was to report on performance for four 
geographic regions, four types of communities, and two socioeconomic levels; and 
conduct its assessment ba^ on samples of students rraponding to only portions 
of the total test. Some of these features, such as regional reporting of results 
and student sampling, served, in part, to counter concerns raised by some groups 
that h&d sugg^ted that a national assessment would lead to undesirable 
comparisons of the performance of different localities and States. 

The NAEP was first funded in FY 1968 at $1 million, according to £D, 
under discretionary authority available at that time. Speciflc authority for 
NAEP was formally enacted in P.L. 95-561, the Education Amendments of 1978. 
The legiL!>tion made few changes to the olyective, structure, or content of the 
ongoing NAEP project. 

FUNDING AND AUTHORIZATION 

For FY 1991, the NAEP appropriation is $19.2 million. The FY 1992 
budget request is $28.1 million. The increase is to be used for the 1992 
demonstration State assessment, aa well as the re^.'ular national a^essment. 
Under the 1992 State demonstration, data will be collected in about 45 States 
and territories from a sample of approximately 350,0(K) students. At the 
national level, approjcimately 140,000 additional students will be assessed. 

The NAEP is authorized as one of several NCES activities under section 
406(i) of the General Education Provisions / jt, title IV of P.L. 90- 247, as 
amended (GEPA). Hiere are authorized to be appropriated such sums as may 
be necessary for the NCES for fiscal years 1990 through 1993 (section 406(0 of 
GEPA). A minimum funding level is specified for the NAEP of $9.5 million in 
FY 1989, and such sums as may be necessary for 1990 through 1993 (section 
405(0 of GEPA). The NAEP was last amended by P.L. 100-297, the Augustus 
F. Hawkins-Robert T. Stafford Elementary and Secondaiy School Improvement 
Amendments of 1988. 

CONTENT AND DESIGN 

The NA£^ must assess reading and mathematics at least once every 2 
years, writing and scienra at least once every 4 yeara, and "history/geography" 
and other subjects (civics, for example) at least once every 6 yeare. Data must 
be collected on students at ages 9, 13, and 17 and in grades 4, 8, and 12. The 
NAEP is responsible for reporting "reliable trends" in achievement data, and it 
must include information on special groups of students (for example, by race or 
ethnicity, or lype of community). Smcpling techniques are required in order to 
make NAEP data representative on a national and regional l^is. For each 
subject area, goal statements must be developed t^roug^ a "national consensus 
approach" that involve" the participation of teachers, curriculum specialists, 
local schooi administrators, jmrents, and the general public. Pr^umably, these 
statements will guide the construction of questions in each subject area assessed. 
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A voluntaiy State demonstra^n project is authorize for the 1990 
and 1992 assesamenta to determine whether valid, reliable, and representative 
data can be obtained at the State level. The 1990 State trial assessed 
matheinati(» in grade 8; the 1992 trial is limited to mathematics in grad^ 4 and 
8, and reading in grade 4. State i»rtidpation is voluntary, the results from any 
State may not be released until the State has reviewed them and given its 
permission for publication. For the 1990 tarial, 40 States and territories 
participated; the number is expected to increase to 45 for the 1992 trial. 
Preliminary results from the 1990 State trial should be available by the summer 
of 1991. The trial demonstration mtast be evaluated by ED with regard to the 
feasibility and validity of individual State assessments and the technical 
problems encountered. A report on the evaluation must be made to the 
Congress and the participating States no later than 18 months after each trial 
assessment At present, no additional State demonstrations are authorized. 

Currently, NAEP uses a type of matrix sampling to reduce the testing 
burden on individual students.^ Under Uiis technique, the large number of 
questions for any given subject is divided so that each student answers only a 
portion of the total assessment. Each participant typically spends an hour or 
less. Different assessment forms are distributed to each sample of students, 
reducing the risk of copying answers from neighbors. Test items are also mixed 
so that no single portion of the test is consistently given last, reducing the risk 
of testing fatigue systematically influencing part of the test results. Test 
questions continue to b*! predominantly multiple choice, but an increasing 
proportion in recent years provide for open-ended responses. 

ADMINISTBATION 

The legislation specifies responsibilities ibr a number of different 
individuals or groups, including the NCES Commissioner of Education Statistics, 
the Assistant Secretary for Educational Research and Improvement, the 
Secretary of Education, and the NAGB. These duties are listed below. In 
general, the Commiraioner has the responsibility for the ovemll administration 
of the NAEP program; the NAGB formulates NAEP policy, and the Secretaiy 
and Assistant Secretaiy have relatively lesser duties. Currently, the NAEP is 
conducted under contract with the EducaSanal Testing Service; competitive 
awards are generally made every 5 yea* ^ 

With regard to NAEP, the Commissioner Education Statistics must: 

• cany out the NAEP program, with the advice of NAGB, by grant, 
contract, or cooperative agreement; 

• provide for an independent evaluation of the State demonstration 
awessment; 



*Mulli8, Ina V.S. Tfu NAEP Guide: A Description of the Conimt and 
Methods of the 1990 and 1992 Assessments. Princeton, Educational Testing 
Service, 1990. p. 37-39. 
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* ensure the coofSdentiality of all personally identifiable NAEP data; and 

* provide for continuing reviews of the NAEP. 
The NAGB is required to: 

* advise the Commissioner of Education Statistics; 

* formulate policy guidelines; 

* select the additional subject areas for asserament every 6 years; 

* identify appropriate achievement goals for each age, grade, and subject 
area assaased; 

* de^lop assessment objectives; 

* develop test specifications; 

* design assessment methodology; 

* develop guidelines and standards for analysis, reports, and 
dissemination of i^ults; 

* develop standards and procedures for interstate, regional, and national 
comparisons; 

* initiate actions needed to improve the form and use of the NAEP; 

* have fmal authority over all cognitive assessment questions; 

* ensura that all questions are free from racial, iultural, gender, or 
regional bias; 

* use no more than 10 percent of the flinds available for NAEP for 
administrative expenses, including staff, consultants, and contracts; 
and 

* subject to the availability of funds, direct an assessment of adult 
literacy. 

The Assistant Secretary for Eklucational R^earch and 
Improvement must serve as an ex officio, nonvoting member of NAGB. 

The Secretary of Education must: 

* appoint the members of NAGB to serve for rotating terms of 4 years 
each (appointments must be made from a list of nominees selected by 
NAGB); 
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• report to NAGB on the Itepartment's implementation of NAGB 
decisions; and 

• enter into an agreement with each State participating in the State 
demonstration to assure that the State will pay firom nonfederal 
sources the nonfederal costs of the assessment, including school level 
administration and the cost of coordination within the State. 

The n^nben of NAGB must include: 

• two governors, or former governors, not of the same political party; 
» two State legislators, not of ihe same political party; 

• two chief State school ofTicero; 

• one superintendent of a local educational agency; 
« one member of a State board of education; 

• one member of a local board of education; 

• three classroom teachers representing the grade levels at which the 
NAEP is conducted; 

• one representative of business or industry; 

• two curriculum specialists; 

• two testing and measurement experts; 

• one nonpublic school administrator or policymaker; 

• two school principals, one elementary and one secondary; and 

• three additional members who are representatives of the general 
public, including parents. 
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